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'  A  gxeatr  deal  of  effort  has  gone  into  research  and  writing  for 

the  book  INFERENCE  AND  DATA  ANALYSIS  FOR  RELIABILITY  AND  LIFE 
TESTING.  The  first  chapter  INFERENCE  FOR  THE  EXPONENTIAL  LIFE  DIS¬ 
TRIBUTION,  ORC  79-16  has  been  again  revised  slightly  due  to  the 
strong  influence  of  an  Air  Force  grant  visitor,  Professor  Dennis 
Lindley.  The  role  of  failures  and  total  time  on  test  was  elucidated 
in  this  report.  Chapter  2,  LIFE  DISTRIBUTION  MODELS  AND  INCOMPLETE 
DATA,  ORC  80-20  has  recently  been  completed.  The  role  of  stopping 
rules  in  statistical  data  analysis  is  now  better  understood.  "Accel¬ 
erated  Life  Tests  and  Information,"  ORC  80-14  is  based  on  actual  ac¬ 
celerated  life  test  experiments  still  in  progress.  The  use  of 
entropy  to  quantify  information  is  investigated.  This  paper  is  to 
be  published  in  RADIATION  RESEARCH  in  a  special  selection  of  papers 
concerned  with  radiation  risk/analysis. 

Chapter  3  on  SAMPLING  FROM  PRODUCTION  PROCESSES  is  in  process. 
This  work  suggests  simple  Bayesian  replacements  for  the  classical 
control  charts.  The  conceptual  basis  for  control  charts  is  reviewed 
in  depth. 

Professor  Dennis  Lindley  visited  Berkeley,  Winter  quarter  1980, 
and  contributed  substantially  to  our  research  program.  He  completed 


J/<-  /c 

.  >3 


Approved  for  public  release  ; 
distribution  unlimited. 


AIR  FORCE  OFFICE  OF  SCIENTIFIC  RESEARCH  (AiSC>*  ( 
NOTICE  OF  TRANSMITTAL  TO  DTIC 
This  technical  report  has  been  reviewed  and  19 
approved  for  public  release  I  Alt’  AFR  190-12. 
Distribution  is  unlimited. 

MATTHEW  J.  K2KPE3 

Chief,  Technical  Information  Division 


i 


a  paper  "The  Bayesian  Approach  to  Statistics,"  ORC  80-9.  This  will 
be  published  in  a  symposium  proceedings.  It  explains  Bayesian  phi¬ 
losophy  to  scientists  and  engineers.  He  has  also  written  another 
paper,  "Scoring  Rules  and  the  Inevitability  of  Probability,"  ORC 
81-1,  January  1981.  This  is  a  very  original  piece  of  work  which 
has  inspired  considerable  additional  research. 

Under  the  Bayesian  paradigm  probability,  measures  must  be  sub¬ 
jectively  assessed.  This  problem  is  addressed  head-on  in  "Coherent 
Assessment  of  Subjective  Probability,"  ORC  81-5.  This  work  utilizes 
duality  theory  to  show  how  incoherent  probability  assessments  can 
be  resolved  using  linear  and  nonlinear  programming.  This  is  a  major 
problem  in  applying  Bayesian  inference  procedures.  The  properties 
and  use  of  scoring  rules  is  being  investigated  at  the  present  time 
and  a  report  on  this  work  will  be  issued  this  Fall. 
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A  great  deal  of  effort  has  gone  into  research  and  writing  for  the  book, 
"Inference  and  Data  Analysis  for  Reliability  and  Life  Testing".  The  first 
chapter,  "Inference  for  the  Exponential  Life  Distribution",  has  been  again 
revised  slightly  due  to  the  strong  influence  of  an  Air  Force  grant  visitor, 
Professor  Dennis  Lindley.  The  role  of  failures  and  total  time  on  test  was 
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elucidated  in  this  report.  Chapter  2,  "Life  Distribution  Models  and 
Incomplete  Data",  has  recently  been  completed.  The  role  of  stopping  rules  in 
statistical  data  analysis  is  now  better  understood.  "Accelerated  Life  Tests 
and  Information",  is  based  on  actual  accelerated  life  test  experiments  still 
in  progress.  The  use  of  entropy  to  quantify  information  is  investigated. 
Chapter  3  on  "Sampling  From  Production  Processes"  is  in  process.  This  work 
suggests  simple  Bayesian  replacements  for  the  classical  control  charts.  The 
conceptual  basis  for  control  charts  is  reviewed  in  depth.  Professor  Lindley 
visited  Berkeley,  winter  quarter  1980,  and  contributed  substantially  to  the 
research  program.  He  completed  a  paper  entitled,  "The  Bayesian  Approach  to 
Statistics".  It  explains  Bayesian  philosophy  to  scientists  and  engineers.  He 
has  also  written  another  paper,  "Scoring  Rules  and  the  Inevitability  of 
Probability".  This  is*  a  very  original  piece  of  work  which  has  inspired 
considerable  additional  research.  Under  the  Bayesian  paradigm  probability, 
measures  must  be  subjectively  assessed.  This  problem  is  addressed  head-on  in 
"Coherent  Assessment  of  Subjective  Probability".  This  work  utilizes  duality 
theory  to  show  how  incoherent  probability  assessments  can  be  resolved  using 
linear  and  nonlinear  programming.  This  is  a  major  problem  in  applying 
Bayesian  inference  procedures.  In  reliability  growth  which  occurs  in  discrete 
stages  1,  2,  ...,  it  is  usual  to  assume  that  the  random  parameters  which 
reflect  the  failure  rate  during  these  stages  obey  a  strict  ordering. 

Following  a  suggestion  by  N.  Singpurwalla,  this  assumption  has  been  weakened 
to  one  in  which  the  parameters  are  stochastically  ordered.  As  shown  in 
"Stochastically-Ordered  Parameters  in  Bayesian  Prediction",  the  problem  now 
becomes  an  hierarchical  Bayesian  model,  in  which  a  sequence  of 
strictly-ordered  hyper-parameters  are  introduced  that  effect  one's  prior 
belief  about  the  reliability  growth.  A  generalized  model  for  reliability 
growth  has  been  under  investigation  in  which  the  failure  rate  is  assumed  to  be 
sum  of  two  effects  —  one  depending  upon  the  'history'  of  failures  since  the 
start  of  testing,  and  the  other  depending  upon  the  'age'  of  the  item  under 
test.  This  quite  general  model  incorporates  many  previously  studied  learning 
curve  models,  for  example,  those  systems  in  which  improvements  are  made  only 
'as  produced',  and  those  made  continuously  'as  operated'.  Both  of  the  models 
require  the  solution  of  two  non-linear  equations  to  find  the  maximum 
likelihood  estimators  of  the  growth  and  aging  parameters.  Numerical  results 
reveal  that,  for  a  single  system  on  test,  the  likelihood  function  is  very 
broad;  therefore,  in  a  Bayesian  formulation,  this  means  that  most  of  the 
prediction  of  ultimate  performance  would  come  from  the  prior.  In  other  words, 
it  now  appears  that  reliability  growth  prediction  requires  the  parallel 
testing  of  large  numbers  of  items.  Details  will  be  given  in  "A  General 
Framework  for  Learning-Curve  Reliability  Growth  Models".  Final  scientific 
report,  "Final  Report,  AFOSR-77-317 9". 
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(Research  under  William  S.  Jewell) 


Reliability  Growth 

In  reliability  growth  which  occurs  in  discrete  stages  1,2,  ..., 
it  is  usual  to  assume  that  the  random  parameters  0^,(L,  ...  which 
reflect  the  failure  rate  during  these  stages  obey  a  strict  ordering 


Following  a  suggestion  by  N.  Singpurwalla ,  this  assumption  has  been 
weakened  to  one  in  which  the  parameters  are  stochastically  ordered. 

As  shown  in  "Stochastically-Ordered  Parameters  in  Bayesian  Predic¬ 
tion,"  ORC  79-11,  November  1980,  the  problem  now  becomes  an  hier¬ 
archical  Bayesian  model,  in  which  a  sequence  of  strictly-ordered 
hyper-parameters  are  introduced  that  effect  one's  prior  belief  about 
the  reliability  growth.  Although  the  model  is  conceptually  clear, 
the  computational  details  are  quite  messy  for  realistic  examples. 

A  generalized  model  for  reliability  growth  has  been  under 
investigation  since  1979,  in  which  the  failure  rate  is  assumed  to 
be  sum  of  two  effects — one  depending  upon  the  "history"  of  failures 
since  the  start  of  testing,  and  the  other  depending  upon  the  "age" 
of  the  item  under  test.  This  quite  general  model  incorporates  many 
previously  studied  learning  curve  models,  for  example,  those  system 
in  which  improvements  are  made  only  "as  produced",  and  those  made 
continuously  "as  operated".  Both  of  the  models  require  the  solution 
of  two  non-linear  equations  to  find  the  maximum  likelihood  estimators 
of  the  growth  and  aging  parameters.  Numerical  results  reveal  that, 
for  a  single  system  on  test,  the  likelihood  function  is  very  broad; 
therefore,  in  a  Bayesian  formulation,  this  means  that  most  of  the 


prediction  of  ultimate  performance  would  come  from  the  prior.  In 
other  words,  it  now  appears  that  reliability  growth  prediction 
requires  the  parallel  testing  of  large  numbers  of  items.  Details 
will  be  given  in  "A  General  Framework  for  Learning-Curve  Reliability 
Growth  Models,"  ORC  79-11,  the  completion  of  which  has  been  inter¬ 
rupted  by  the  author's  sabbatical  leave. 

Risk  Models 

At  the  invitation  of  the  International  Actuarical  Association, 
the  author  prepared  a  survey  paper  on  risk  models  for  a  plenary 
session  of  the  21st  International  Congress  of  Actuaries,  entitiled 
"Models  in  Insurance:  Paradigms,  Puzzles,  Communications,  and 
Revolutions,"  ORC  80-10.  Although  the  terminology  is  that  of 
insurance,  this  paper  should  provide  a  useful  survey  of  available 
models,  with  an  extensive  reference  list,  to  anyone  interested  in 
individual  and  organizational  financial  risk. 

Inverse  Regression 

In  1976,  the  author  and  R.  Avenhaus  (now  at  the  Armed  Forces 
Institute  Munich)  wrote  a  joint  paper  on  a  linearized  Bayesian 
approach  to  inverse  regression.  With  the  help  of  E.  Hopfinger 
(Nuclear  Research  Center,  Jiilich)  ,  this  paper  was  expanded  and 
distributed  as  "Approaches  to  Inverse  Linear  Regression,"  ORC  80-21. 

Other  Activities 

In  addition  to  the  International  Congress  of  Actuaries  in 


Switzerland,  June  1980,  described  above,  Professor  Jewell  gave  a 


survey  of  reliability  growth  models  at  the  IMS  Western  Regional 
Meeting  at  Davis,  California,  June  1980. 

From  August  1980  until  June  1981,  Professor  Jewell  was  on 
sabbatical  leave  at  the  Federal  Institute  of  Technology,  Zurich. 
His  initial  research  activity  was  on  the  development  of  Bayesian 
techniques  for  the  shaping  of  data  subject  to  outliers.  This  and 
other  research  is  described  more  fully  in  the  research  proposal 
for  1981-1982. 
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